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Deepfakes Video 
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Face Swapping Video Generation 


Characteristics 

° Swap victim’ s face in every frame independently 
* Not End2End 

* Only manipulate central face area 

° Autoencoder 


DeepFakes 


Faces Swapping 


Extracting video frames Generating the fake video 


Deepfakes Training Phase 
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Deepfakes Generation Phase 


° Convert 


— Person A Encoder -> Person B Decoder 


* Merge back 


— Gaussian Blur/Color Average 


— Poisson Image Editing 
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* Deepfakes Video 
* A simple and effective CNN 


— capturing low-level features of the images 


* Face recognition based method 


A Simple and Effective CNN 


Design purpose 
* Input contains marginal (background) information. 


* Capture low-level features of the images. 
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A Simple and Effective CNN 


Training 
* Dataset from VidTIMIT 
— 67600 fake faces and 66629 real faces 
— low quality and high quality images 
* Cropped faces 
— with face landmark detector MTCNN 
— obtain 1.5 scaled bounding box 
* Augmented data 
— horizontal flipping 


— randomly zooming 


— shearing transformations 


A Simple and Effective CNN 


Characteristics 
3 convolution layers 


* Accuracy rate: 99% 


Input 16@(3, 3) 32@(1, 1) 32@(3, 3) FC FC 
256 * 256 “3 relu relu relu relu sigmod 


maxpooling maxpooling maxpooling dropout 
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* Deepfakes Video 
* A simple and effective CNN 


* Face recognition based method 


— capturing high-level features of faces 


What is FaceNet? 


Characteristics 
e SOTA CNN for face recognition 


* Model structure 
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* Triple Loss 
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FaceNet: A unified embedding for face recognition and clustering 


A FaceNet based SVM classifier 
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Training 
* Central Face area 


— No margin/background 
— Only face area 


* Dataset from VidTIMIT 


FaceNet 


Heal Faces 
Dataset 


Feature Extraction 


A FaceNet based SVM classifier 


Characteristics 

* FaceNet used for extracting face features 
* SVM for binary classification 

* Accuracy rate: 94% 


Features Extraction 


Face Detection 


Binary Classification 


A Simple and Effective CNN 


Accuracy rate: 99% 


A FaceNet based SVM classifier 


Accuracy rate: 94% 


Summary 


* CNN for image classification 
— A simple architecture can work well. 


— catching low-level features: contours, edges: 


* A FaceNet based SVM classifier 


— using FR to catch features of fake faces 
— using SVM for binary classification 


— 64% accuracy rate for the misclassification set from the sim 
ple CNN based classifier 
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